Robustness and Enhancement of Neural Synchronization 
by Activity-Dependent Coupling 
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We study the synchronization of two model neurons coupled through a synapse having an activity- 
dependent strength. Our synapse follows the rules of Spike-Timing Dependent Plasticity (STDP). 
We show that this plasticity of the coupling between neurons produces enlarged frequency locking 
zones and results in synchronization that is more rapid and much more robust against noise than 
classical synchronization arising from connections with constant strength. We also present a simple 
discrete map model that demonstrates the generality of the phenomenon. 

PACS numbers: 05.45.Xt, 87.18.Sn, 87.18.Bb 
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Synchronous activity among individual neurons or 
their ensembles is a robust phenomenon observed in 
many regions of the brain, in sensory systems and in other 
neural networks. With constant synaptic connections the 
regions of neural synchronization are quite narrow in pa- 
rameter space and the origin of the observed robustness 
of synchronization is not clear. It is known that many 
neurons in the cortex, in the cerebellum and in other 
neural systems are coupled through excitatory synap- 
tic connections whose strength can be altered through 
activity-dependent plasticity. Indeed, this plasticity is 
widely thought to underlie learning processes, and in it- 
self constitutes a broadly interesting phenomenon. Here 
we discuss its role in the synchronization of neurons in a 
network. 

There have been recent experimental advances in the 
understanding of such plasticity, and, in particular, of the 
critical dependence on timing in presynaptic and post- 
synaptic signaling. Two manifestations of this kind of 
synaptic plasticity are the Spike-Timing Dependent Plas- 
ticity (STDP) jy, ||] seen in excitatory connections be- 
tween neurons, and its inverse, observed, for example, in 
the connections between excitatory and inhibitory neu- 
rons in the electrosensory lobe of fish M . The connections 
between excitatory neurons through inhibitory interneu- 
rons are typical in sensory systems || and cerebral 
cortex ||. These also express synaptic plasticity JtJ and 
play an important role in the control and synchronization 
of neural ensembles in hippocampus. 

We report here on the synchronization of two model 
neurons coupled through STDP or inverse STDP 
synapses. We demonstrate that such coupling leads to 
neural synchronization which is more rapid, more flex- 
ible and much more robust against noise than synchro- 
nization mediated by constant strength connections. (For 
reviews, see M, pi Ibl). We also build a simple discrete 



map that illustrates the enhancement of synchroniza- 
tion by activity-dependent coupling. The map allows us 
to speculate about the general applicability of learning- 
enhanced synchronization. 

We consider here the simplest neural network: two 
neurons with unidirectional, activity-dependent excita- 
tory synaptic coupling. Each neuron is described by 
the Hodgkin-Huxley equations with standard Na, K, and 
'leak' currents [Ol: 
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where i = 1, 2. 

Each of the activation and inactivation variables 
yi(t) — {rij(t) , TOi(t) , hi(t)} satisfies first-order kinetics 



dyi(t) 
dt 
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The parameters in these equations are given in Jl2| . 

Each neuron receives a constant input I s u m forcing it 
to spike with a constant, / st i m -dependent frequency. The 
second neuron is synaptically driven by the first via an 
excitatory current dependent on the postsynaptic V2(t) 
and presynaptic V±(t) membrane voltages: 



Isyn(t) = g(t)S(t)V 2 (t). 



(3) 



S(t) is the fraction of open synaptic channels. It satisfies 
first-order kinetics: 



dS{t) 
dt 



a(l-S(t))H{Vi(t))-0S(t), 



(4) 



'Electronic address: shigulin@caltech.edu 



with H(Vi(t)) = (1 + tanh(10Fi(t)))/4. 

The time dependent synaptic coupling strength g(t) is 
conditioned by the dynamics of the pre- and postsynaptic 
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neurons. We consider two types of activity-dependent 
couplings: (1) an excitatory synapse with STDP, and 
(2) an excitatory synapse with inverse STDP. Through 
STDP g{t) changes by Ag(t) which is a function of the 
time difference At = t post — t pre between the times of 
post- and presynaptic spikes. We use the additive update 
rule 

Ag(t) = G(At) = A sgn(Ai) exp (- 7 | At\) (5) 

for STDP, and Ag(t) = -G(At) for inverse STDP. We 
used A = 0.004 /iS and 7 = 0.15ms" 1 . 

We studied the synchronization properties of this cou- 
pled system by setting the autonomous period of the 
postsynaptic neuron to 15 ms, then evaluating the ac- 
tual period of its oscillation T2 as a function of the im- 
posed autonomous oscillation period T\ of the presynap- 
tic neuron. In Fig. ^ we show T1/T2 as a function of 
Ti in two cases: (a) a synaptic coupling with constant 
strength 0.008 /iS and (b) a synaptic coupling with in- 
verse STDP. In the later case the steady-state coupling 
strength depends on the ratio of neuronal frequencies (c). 
Its average over all Ti values is 0.002 /j,S, which is much 
lower than the strength in the case of constant coupling. 

In Fig. [l]a we see the familiar 'Devil's Staircase' asso- 
ciated with frequency locking domains of a driven non- 
linear oscillator. Only frequency locking with ratios 1:1, 
2:1, 3:1, and 4:1 leads to synchronization plateaus with 
significant width. In Fig. ^b we see that the synchroniza- 
tion domains are substantially broadened due to activity- 
dependent coupling, especially for T1/T2 = 1. Some 
synchronization plateaus exhibit multistability, which we 
confirmed by observing the associated hysteresis. These 
results show that even a weak, but adaptive connection 
with strength that is determined dynamically is able to 
greatly enhance and enrich synchronization. 

We also studied the robustness of this enhanced syn- 
chronization in the presence of noise by adding zero 
mean, Gaussian, white noise to the membrane currents of 
each neuron. We examined the behaviour of the system 
with RMS noise amplitudes a = 0.01, 0.05, 0.1, and 0.5 
nA. 

For <7 = 0.01 nA no phase-locking plateaus were de- 
stroyed. At a — 0.05 nA the 4:1 plateau became dis- 
torted. Larger a sequentially eliminated synchronization 
plateaus until only the 1:1 plateau remained. The 1:1 
plateau was seen for all a. In Fig. | we illustrate the 
effect of the noise on synchronization when a = 0.1 nA 
with (a) constant and (b) inverse STDP coupling. While 
in (a) most of the plateaus have disappeared, in (b) the 
1:1, the 2:1 and even the 3:1 frequency locking regimes re- 
mained. In sharp distinction to classical synchronization, 
frequency locking through activity-dependent coupling is 
significantly more robust in the presence of noise. 

To understand the mechanisms behind such a remark- 
able robustness we studied the diffusion of oscillation 
phase caused by noise. For a = 0.5 nA in Fig. | a we 
show that in the case of 1:1 synchronization and coupling 
with constant strength 0.008 [iS noise-induced phase dif- 
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FIG. 1: Devil's Staircase for (a) constant synaptic strength 
and (b) synaptic strength varying according to inverse STDP 
coupling. Ti and T 2 are the observed periods of the presynap- 
tic (driving) neuron and postsynaptic (driven) neuron respec- 
tively. In (c) the final value of synaptic strength is displayed. 



fusion results in 27r phase slips that destroy synchronized 
state. Quite contrary Fig. [|b shows that in the case of 
activity-dependent coupling phase slips are absent and 
the phase difference does not increase. In this particular 
case the strength of coupling varied around the mean of 
0.0064 with standard deviation of 0.0026 fiS. 

In Fig. H we plot the average rate of phase slips for 
different amplitudes of the noise. In line with the above 
observation we see that in the case of activity-dependent 
coupling (dashed line) phase slips are suppressed in a 
wide range of noise amplitudes. We argue here that this 
suppression of phase slips is the primary mechanism re- 
sponsible for robustness of synchronization mediated by 
activity-dependent coupling. After the introduction of 
a discrete map model we will discuss this mechanism in 
more detail. 

We also considered synchronization through an 
activity-dependent synapse in the interesting case when 
the presynaptic neuron produces bursts of spikes and the 
postsynaptic neuron spikes irregularly. We found that 
synchronization through an STDP synapse is very fast; 
even a few spikes are enough for the frequency locking 
to establish itself. Neurons in the same set up with con- 
stant coupling synchronize much more slowly and only 
if the strength of the connection is appropriate for the 
given ratio of their frequencies. Hence, activity depen- 
dent synapses allow adaptation 'on the run,' synching a 
postsynaptic neuron to the firing properties of its presy- 
naptic partner. 
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FIG. 2: Same as Fig. [l], but with zero mean, Gaussian, white 
noise with a = 0.1 nA added to the membrane currents. 



To understand the above results in a general way we 
have constructed a discrete time map model of periodic 
generators with STDP-like coupling. This map accounts 
for the dependence of the coupling strength on the ac- 
tivity of generators. Take T® and T® as the autonomous 
periods of the first and second generators. As a result of 
unidirectional coupling, the period of the second genera- 
tor will change by some amount AT each time it receives 
a spike from the first generator. Assuming initial phases 
to be 0, the time of the n+ 1st spike of the first generator 
and m + 1-st spike of the second generator are taken to 
satisfy 



n+l 

(2) 

771+1 



+ (2) I _ A rp 
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where n and m are such that t 

eral, AT m n would be a function of T-f, T° , tn > , tm\ and 
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the coupling strength 



variables here are tn^ — tm\ and g m 
case AT m .„ can be approximated by 



We argue that the two main 
In the simplest 
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where the function F(x) is the analog of a phase response 
curve |l3| for our model. To obtain results quantitatively 
comparable with our neuronal model, we fit it by non- 
negative quadratic function that describes phase response 
of our model neurons: F(x) = 835 + 63x — 9x 2 for < 
x < T§ and otherwise. g m . n obeys the inverse STDP 
update rules: 



ym+l,n 
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FIG. 3: The difference of oscillation phases of two neurons 
as a function of time in the cases of (a) constant and (b) 
activity-dependent coupling. 
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FIG. 4: Average rate of phase slips as a function of RMS noise 
amplitude for the case of 1:1 synchronization and constant 
(solid line) or activity-dependent (dashed line) coupling. 



In Fig. pi we show the Arnol'd Tongues calculated for 
the map ^-||) in the cases of (a) constant and (b) inverse 
STDP coupling. As with the model neurons, we see that 
activity-dependent coupling greatly enlarges the zones of 
synchronization. 

This discrete map can be further analyzed to find its 
fixed points corresponding to n : m synchronization and 
to examine their stability. We present here only the case 
of 1:1 synchronization. Then m = n, and the system 
of equations (^[^) can be written in the following simple 
form: 



Tn+l = T„+T 1 °-T 2 °+ 5 „F(T„) 

ffn+l = Qn — G{T X — T n+ i) — G{— Tn+l), 



(9a) 
(9b) 



where r, 
if - 



= t 
->o 



(i) 



,(2) 



The fixed points of (H) are given 
by 9l = {Tl - T?)/F{rl) and r,{ = T°/2. Stability cal- 
culations show that for such F(t) and G(t) these fixed 
points are stable. The second fixed point illustrates that 
activity-dependent coupling introduces a new limitation 
on the relationship between the phases of two oscillators. 
It is this limitation that causes the suppression of phase 
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FIG. 5: Arnol'd Tongues calculated for the discrete map 
model with (a) constant and (b) activity-dependent coupling. 
T 2 ° = 13 ms. 

slips under the influence of noise. Detailed analysis shows 
that in the course of noise-affected synchronization the 
strength of activity-dependent coupling ajusts dynami- 
cally to keep this phase relationship close to satisfaction 
and, hence, suppresses phase slips. 

In conclusion, we have analyzed the effects of activity- 
dependent coupling on synchronization properties of cou- 
pled neurons. We showed that such coupling results in 



a substantial extension of the temporal synchronization 
zones, leads to more rapid synchronization and makes 
it much more robust against noise. The enlargement of 
synchronization zones means that with STDP-likc learn- 
ing rules the number of synchronized neurons in a large 
heterogeneous population must increase. In fact, this is 
an aspect of the popular idea due to Hebb [|l4|. It is 
supported by the results in jlj, which indicate that 
the coherence of fast EEG activity in the gamma band 
increases in a process of associative learning. 

Based on our discrete map model results, we argue 
that the particular details of the signal-generating devices 
(e.g. neurons) and their connections (e.g. synapses) are 
not essential and the obtained results have general ap- 
plicability. In fact, we observed similar phenomena of 
robust and enhanced synchronization in computer sim- 
ulations of other types of periodic generators (such as 
Van-der-Pol and 0-oscillators) with STDP-like activity- 
dependent coupling. 
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